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Abstract 

Although  joint  programs  are  typically  formed  to  reduce  costs,  recent  studies  have  suggested 
that  they  may  actually  be  more  costly  than  non-joint  programs.  In  this  paper,  we  explore  this 
hypothesis  using  an  in-depth  case  study  of  the  NPOESS  program.  To  study  jointness,  we 
apply  a  semi-quantitative  framework  that  quantifies  the  complexity  impacts  of  jointness  and 
enables  us  to  observe  their  evolution  over  time.  In  particular,  we  describe  how  jointness 
impacted  the  NPOESS  program — by  inducing  technical  and  organizational  complexity — and 
illustrate  how  the  relationship  between  both  complexity  types  enabled,  sustained,  and 
induced  cost  growth.  We  also  explain  the  evolution  of  the  program’s  technical  and 
organizational  complexity  by  identifying  five  key  technical  decisions  and  collaborating  agency 
interactions  that  increased  complexity  and  cost.  Finally,  we  conclude  by  noting  that  a  key 
source  of  the  NPOESS  program’s  cost  growth  was  not  jointness  per  say,  but  rather,  was  the 
result  of  a  mismatch  in  the  amount  of  jointness  that  was  present  in  the  program’s  technical 
system  but  was  absent  in  its  managing  organization. 

Introduction 

Jointness  has  numerous  benefits:  It  enables  government  agencies  to  design  for 
interoperability,  to  leverage  a  particular  agency’s  unique  technical  capabilities,  to  benefit 
from  mission  and  technical  synergies,  and  to  reduce  a  capability’s  overall  cost.  However, 
despite  these  benefits,  recent  studies  suggest  that  joint  programs  may  also  have  a  critical 
disadvantage  because  they  exhibit  greater  cost  growth  than  non-joint  programs  (Brown, 
Flowe,  Hamel,  2007;  Cameron,  2011;  Lorell  etal.,  2013;  The  National  Research  Council, 

201 1 ).  This  paper  focuses  on  the  cost  of  jointness  so  that  future  government  decision- 


MSi 

TMlBWlTt*  MH 


-89- 


ACQUISITION  RESEARCH  PROGRAM: 
CREATING  SYNERGY  FOR  INFORMED  CHANGE 


makers  can  make  more  informed  cost-benefit  trades  when  deciding  to  develop  capabilities 
jointly. 

To  understand  why  joint  programs  incur  greater  cost  growth,  future  decision  makers 
require  an  improved  understanding  of  how  jointness  has  contributed  to  cost  growth  in  the 
past.  Our  paper  responds  to  this  need  by  presenting  the  results  of  an  in-depth  case  study  of 
the  National  Polar-orbiting  Operational  Environmental  Satellite  System  (NPOESS)  program 
that  specifically  explores  the  relationship  between  cost  growth  and  jointness.  We  begin  by 
outlining  the  framework  that  we  used  to  study  jointness  on  NPOESS.  Next,  we  review  our 
results  by  presenting  a  brief  history  of  the  program,  by  identifying  key  decisions  that  induced 
technical  and  organizational  complexity,  and  by  describing  the  mechanisms  by  which 
complexity  generated  cost  growth.  Finally,  we  conclude  by  connecting  the  identified 
complexity  mechanisms  to  the  concept  of  jointness  and  by  suggesting  strategies  that  can  be 
used  to  manage  cost  growth  on  future  joint  programs. 

A  Framework  to  Assess  the  Impacts  of  Jointness 

In  this  paper,  we  define  jointness  in  terms  of  a  program’s  organizational  and 
technical  architecture.  Crawley  et  al.  (2004)  define  architecture  as  “an  abstract  description  of 
the  entities  of  a  system  and  the  relationships  between  those  entities”:  essentially,  a  system’s 
architecture  is  defined  by  its  components  and  by  the  relationships  between  them.  In  our 
framework,  we  distinguish  between  two  types  of  jointness:  organizational  and  technical.  A 
joint  technical  architecture  is  one  that  meets  a  diverse  set  of  requirements  from  distinct  and 
separate  user  groups.  A  joint  organizational  architecture  is  one  that  accommodates 
participation  from  more  than  one  government  agency.  Given  this  definition,  programs  can  be 
classified  as  either  technically  joint,  organizationally  joint,  or  as  exhibiting  both  types  of 
jointness;  Figure  1  classifies  several  example  programs  according  to  these  jointness  types. 

Importantly,  joint  architectures  can  also  be  defined  by  their  ability  to  be 
disaggregated.  Specifically,  a  joint  technical  architecture  executes  an  aggregated  set  of 
requirements  that  could  be  alternatively  executed  by  multiple  distinct  systems.  Similarly,  joint 
organizational  architectures  are  also  aggregated  and  can  be  disaggregated  if  government 
agencies  develop  systems  independently  instead  of  collaboratively.  A  current  movement  in 
the  space  acquisition  community,  which  supports  the  disaggregation  of  previously  joint 
programs,  suggests  two  hypotheses  that  connect  jointness  to  cost  growth  and  motivate  our 
focus  on  joint  program  architectures.  The  first  hypothesis  suggests  that  aggregated 
technical  architectures  are  more  complex  than  disaggregated  ones  and  that  when  this 
complexity  is  not  identified,  budgeted  for,  and  actively  managed — it  induces  cost  growth  on 
joint  programs  (Air  Force  Space  Command,  2013;  Burch,  2012;  Pawlikowski,  Loverro, 
Cristler,  2001;  Rendleman,  2009;  Taverney,  2011).  The  second  hypothesis  suggests  that 
aggregated  organizational  architectures  are  more  complex  than  disaggregated  ones  and 
that  this  complexity  induces  and  enables  cost  growth  on  joint  programs  (Bogdanos,  2005; 
Brown,  Flowe,  &  Hamel,  2007;  Johnson,  Hilgenberg,  &  Sarsfield,  2001;  Moore  et  al.,  2013; 
The  National  Academies,  201 1 ).  Given  these  hypotheses,  we  suggest  that  in  order  to 
understand  the  relationship  between  jointness  and  cost  growth,  we  must  (1)  identify  the 
mechanisms  within  a  joint  program’s  technical  and  organizational  architectures  that  induce 
complexity  and  (2)  study  the  process  by  which  these  mechanisms  induce,  enable,  and 
sustain  cost  growth  over  time. 
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Figure  1.  Example  Programs  Classified  in  Terms  of  Type  of  Jointness 

To  study  jointness  in  this  way,  we  developed  a  semi-quantitative  framework  (Dwyer 
&  Szajnfarber,  2014)  to  represent  joint  program  architectures  using  design  structure 
matrices  (DSMs;  Eppinger  &  Browning,  2012)  and  to  quantify  their  complexity  using  metrics. 
Specifically,  our  framework  defines  two  separate  DSMs  to  represent  a  program’s 
organizational  and  technical  architectures  and  the  complexity  mechanisms  within  them  and 
calculates  two  metrics  that  quantity  the  complexity  inherent  within  each  architecture.  To 
apply  this  framework  to  study  NPOESS,  we  define  the  program’s  architectures  during  six 
epochs — or  periods  of  time  when  those  architectures  were  unique  and  stable — and  observe 
the  evolution  of  complexity  and  its  relationship  to  cost  growth  over  time. 

In  our  framework,  we  define  technical  complexity  to  be  a  function  of  the  components 
of  a  system  and  the  interactions  between  those  components.  Three  types  of  technical 
complexity  mechanisms  are  represented  in  our  technical  architecture  DSM  and  included  in 
our  complexity  metric,  which  serves  as  a  proxy  for  the  program’s  lifecycle  cost,  corrected  for 
complexity.  We  define  the  three  types  of  technical  complexity  mechanisms  as 

•  Design  complexity,  which  is  a  function  of  the  technical  maturity  of  each 
component, 

•  Process  complexity,  which  is  a  function  of  the  constraints  or  conflicting 
requirements  that  are  imposed  during  the  component  development  process, 
and 

•  Architectural  complexity,  which  is  a  function  of  the  interactions  and 
relationships  between  components. 

Next,  we  represent  the  program’s  organizational  architecture  by  mapping 
relationships  between  organizational  components,  which  are  distinct  sub-units  within  the 
organization  that  include  the  government  agencies,  user  communities,  program  offices,  and 
contractors.  The  two  relationships  that  are  critical  to  our  definition  of  organizational 
complexity  are 
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•  Mission  responsibility,  which  indicates  that  an  organizational  component  is 
responsible  for  delivering  a  technical  system  that  executes  its  specified 
mission,  and 

•  Decision  authority,  which  indicates  that  an  organizational  component  it  is  able 
to  make  and  sustain  effective  decisions. 

We  define  organizational  complexity  to  be  a  function  of  the  misalignment  of  mission 
responsibility  and  decision  authority  and  factors  that  erode  decision  authority.  We  suggest 
that  organizational  complexity  is  related  to  cost  growth  because  as  an  organization’s 
complexity  increases,  it  becomes  more  difficult  for  the  organization  to  make  effective  and 
efficient  decisions;  as  a  result,  complex  organizations  are  more  likely  to  enable,  sustain,  and 
induce  cost  growth.  To  assess  organizational  complexity,  we  use  a  metric  that  quantifies  the 
misalignment  of  mission  responsibility  and  decision  authority  and  the  erosion  of  decision 
authority. 

To  apply  our  framework  to  study  the  impacts  of  jointness  on  NPOESS,  we  collected 
a  mix  of  qualitative  and  quantitative  data.  In  total,  we  interviewed  57  representatives  from 
the  program  and  collected  over  75  hours  of  semi-structured  qualitative  interview  data 
(Eisenhardt  &  Graebner,  2007;  Yin,  2009).  As  recommended  by  Eisenhardt  &  Graebner 
(2007)  we  sampled  interviewees  from  multiple  levels  in  the  program’s  organizational 
hierarchy  and  we  triangulated  (Yin,  2009)  our  data  using  over  150  primary  and  secondary 
source  documents.  In  the  following  sections,  we  summarize  the  conclusions  of  our  analysis; 
for  a  complete  description  of  our  data-set  and  a  mapping  between  each  of  our  subsequent 
conclusions  and  its  supporting  data,  please  refer  to  Dwyer  (2014). 

A  Brief  History  of  the  NPOESS  Program 

NPOESS  was  a  collaboration  between  the  Department  of  Defense  (DoD),  the 
National  Oceanic  and  Atmospheric  Administration  (NOAA),  and  the  National  Aeronautics 
and  Space  Administration  (NASA)  that  was  intended  to  develop  a  constellation  of 
environmental  monitoring  satellites  for  low-Earth  orbit;  NPOESS  was  established  in  1994 
and  cancelled — due  to  cost  growth,  schedule  delays,  and  management  issues  (The  White 
House,  2010) — in  2010.  The  NPOESS  system  met  the  requirements  of  multiple  user  groups 
and  was  developed  collaboratively  by  all  three  agencies;  as  such,  NPOESS  is  an  important 
example  of  both  organizational  and  technical  jointness.  To  observe  the  evolution  of  the 
program’s  complexity  and  cost  over  time,  we  defined  six  epochs  and  represented  the 
program’s  organizational  and  technical  architectures  for  each;  the  DSMs  created  for  each 
epoch  are  contained  in  Dwyer  (2014).  Key  events  during  each  epoch  include: 

Epoch  A  (1994-1996):  NPOESS  was  established  by  converging  NOAA’s  Polar 
Operational  Environmental  Satellite  (POES)  program  and  the  DoD’s  Defense  Meteorological 
Satellite  Program  (DMSP)  and  was  motivated  by  the  desire  to  save  $1 .3  billion  in  lifecycle 
costs  (Gore,  1993).  These  cost  estimates  assumed  that  the  NPOESS  technical  architecture 
would  be  composed  of  a  constellation  of  three  operational  spacecraft  with  modest 
performance  improvements  over  POES  and  DSMP.  To  manage  the  development  of  the 
NPOESS  system,  an  Integrated  Program  Office  (IPO)  was  established  and  staffed  by  all 
three  agencies.  An  Executive  Committee  (EXCOM),  which  was  composed  of  the  NASA 
Deputy  Administrator,  the  Under  Secretary  of  Commerce  for  Oceans  and  Atmosphere,  and 
the  Under  Secretary  of  Defense  for  Acquisition  and  Technology,  was  also  created  to  provide 
policy  guidance  and  to  approve  changes  to  the  program’s  baseline. 

Epoch  B  (1996-1999):  The  NPOESS  system  requirements  were  defined  in  the 
Integrated  Operational  Requirements  Document  (IORD-1).  To  meet  these  new  requirements, 
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four  new  instruments  were  added  to  the  technical  architecture  and  the  existing  instruments 
evolved  to  more  closely  resemble  the  higher  performance  instruments  in  NASA’s  Earth 
Observing  System  (EOS).  Additionally,  according  to  its  “optimized  convergence”  acquisition 
strategy,  the  program  office  managed  multiple  risk  reduction  contracts  for  each  of  its  key 
instruments  but  delayed  selecting  a  prime  contractor.  NOAA  and  the  DoD  shared  financial 
responsibility  for  funding  these  contracts,  which  were  managed  according  to  DoD  acquisition 
processes;  although  NASA  participated  in  the  IPO,  the  EXCOM,  and  the  requirements 
development  process,  it  did  not  officially  levy  requirements  on  the  system  and  provided  no 
funding. 

Epoch  C  (1999-2002):  The  NASA-managed  NPOESS  Preparatory  Project  (NPP) 
was  established  to  execute  two  missions:  (1 )  to  provide  risk  reduction  for  key  sensors  and 
(2)  to  provide  data  continuity  for  several  climate  science  variables.  To  execute  NPP’s  dual 
missions,  the  IPO  managed  and  funded  the  development  of  three  of  its  critical  sensors  while 
NASA’s  separate  NPP  program  office  procured  and  funded  a  spacecraft  bus,  developed  and 
funded  an  additional  sensor,  funded  NPP  launch  costs,  and  managed  the  system’s 
integration.  To  meet  the  needs  of  the  program’s  new  climate  science  users,  the  lORD’s 
requirements  were  updated  to  enhance  instrument  performance  and  one  additional  sensor 
was  added. 

Epoch  D  (2002-2005):  The  prime  contract  was  awarded  and  all  of  the  instrument 
and  algorithm  contracts  that  were  previously  selected  and  managed  by  the  IPO  were 
transferred  to  the  prime;  shortly  after  this  transfer,  the  program’s  cost  estimates  began  to 
grow. 

Epoch  E  (2005-2007):  The  program’s  cost  estimates  increased  so  significantly  they 
breached  the  Nunn-McCurdy  threshold  and  the  program  had  to  undergo  certification.  As  a 
result,  four  instruments  and  two  spacecraft  were  cancelled  and  a  Program  Executive  Officer 
(PEO)  was  added  to  streamline  decision-making  between  the  IPO,  the  NPP  program  office, 
and  the  EXCOM. 

Epoch  F  (2007-2010):  Two  instruments  were  added  back  to  the  technical 
architecture  and  despite  the  new  PEO-authority  structure,  management  challenges 
persisted  and  cost  estimates  continued  to  grow  until  the  program’s  cancellation  in  2010. 

By  representing  the  program’s  organizational  and  technical  architectures  during  each 
epoch,  quantifying  their  complexity,  and  normalizing  each  complexity  metric  by  the 
complexity  of  the  predecessor  POES  and  DMSP  architectures,  we  are  able  to  draw  several 
conclusions  about  the  evolution  of  the  program’s  costs.  First,  Figure  2  plots  our  technical 
complexity  metric  (a  proxy  for  lifecycle  cost)  alongside  the  program’s  own  lifecycle  cost 
estimate;  this  illustrates  that  the  program’s  technical  complexity  increased  after  Epoch  A, 
while  its  cost  estimates — particularly  after  Epoch  B — continued  to  remain  low.  This  suggests 
that  the  changes  to  the  technical  architecture  between  Epochs  A  and  C  added  a  significant 
amount  of  design,  process,  and  architectural  complexity  that  was  under-estimated  and 
under-managed  by  the  program  until  Epoch  D,  when  its  cost  estimates  began  to  increase. 

As  noted  in  Figure  2,  during  these  early  epochs,  we  suggest  that  organizational  complexity 
enabled  the  program’s  technical  costs  to  be  under-estimated  and  under-managed.  After 
Epoch  D,  when  the  program’s  costs  were  clearly  no  longer  a  function  of  its  technical 
architecture,  we  suggest  that  additional  cost  growth  was  induced  by  organizational 
complexity.  Using  these  relationships  between  complexity  and  cost  growth,  we  organize  our 
subsequent  discussion  according  to  the  following  principles: 

•  First,  we  suggest  that  technical  decisions  induced  cost  growth  by  introducing 
design,  process,  and  architectural  complexity  into  the  NPOESS  technical 
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architecture.  Technical  decisions  are  those  that  were  made  within  the 
NPOESS  organization  but  were  responsive  to  the  collaborating  agencies’ 
interactions  with  each  other  and  with  the  NPOESS  program  offices. 

•  Second,  agency  interactions  with  each  other  and  with  the  NPOESS  program 
offices  induced  organizational  complexity  by  misaligning  decision  authority 
and  mission  responsibility  and  by  eroding  decision  authority  within  the 
NPOESS  organization.  Agency  interactions  were  often  formally  documented 
in  policy  directives  that  were  implemented  by  the  NPOESS  program; 
however,  unofficial  agency  interactions  also  induced  organizational 
complexity. 
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Figure  2.  Evolution  of  and  Relationship  Between  Complexity  and  Cost 

We  suggest  that  organizational  and  technical  complexity  are  related  because  as  the 
NPOESS  organization’s  complexity  increased,  it  enabled  and  sustained  costlier  technical 
decisions.  We  also  suggest  that  organizational  complexity  is  directly  related  to  cost  growth 
because  organizational  complexity  hindered  the  program’s  decision-making  process  by 
making  less  efficient.  In  the  following  sections,  we  define  the  decisions  and  interactions  that 
introduced  complexity  into  the  NPOESS  technical  and  organizational  architectures  and 
describe  the  mechanisms  by  which  these  decisions  and  interactions  generated  complexity 
and  ultimately  enabled,  sustained,  and  induced  cost  growth. 

Decisions  That  Induced  Technical  Complexity 

Figure  3  plots  the  evolution  of  technical  complexity  and  identifies  the  five  major 
decisions  that  induced  it.  As  noted  above,  we  define  technical  complexity  to  be  a  function  of 
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a  system’s  components  and  component  interactions  and  to  consist  of  three  types  of 
mechanisms:  design,  process,  and  architectural.  The  mechanisms  that  were  injected  into 
the  NPOESS  technical  architecture  after  each  decision  are  captured  in  the  DSMs — shown  in 
miniaturized  form — and  by  the  value  of  the  complexity  metric  that  was  calculated  for  each 
epoch.  As  shown,  a  majority  of  the  system’s  complexity  was  induced  by  early  technical 
decisions  and  even  after  the  Nunn-McCurdy  certification — a  process  intended  to  reduce 
complexity — complexity  continued  to  increase  until  the  program’s  cancellation.  In  this 
section,  we  review  these  major  technical  decisions  and  discuss  the  design,  process,  and 
architectural  complexity  that  they  induced. 

Decision  1  (Define  the  IQRD-0:  The  first  complexity  inducing  decision  was  to  define 
the  system’s  requirements  in  the  IORD-1;  as  shown  in  Figure  3,  this  decision  increased  the 
system’s  complexity  to  a  level  that  was  only  slightly  less  than  the  pre-convergence  POES 
and  DSMP  systems.  Interviewees  described  the  IORD-1  as  a  concatenation  of  each 
agency’s  unique  or  driving  requirements;  as  such,  the  IORD-1  induced  both  architectural  and 
design  complexity.  First,  the  IORD-1  induced  architectural  complexity  by  requiring  that  four 
new  instruments  be  added  to  the  technical  architecture  so  that  several  agency-unique 
requirements  could  be  met.  For  example,  a  radar  altimeter  was  added  primarily  to  meet 
Navy  requirements  and  a  solar  irradiance  and  earth  radiation  budget  sensor  were  added  to 
meet  NOAA-unique  requirements;  importantly,  because  none  of  these  sensors  were  hosted 
by  either  heritage  POES  or  DMSP  they  ultimately  increased  NPOESS’s  architectural 
complexity  compared  to  these  heritage  programs.  The  fourth  sensor  that  was  added  after 
the  IORD-1  was  a  cross-track  scanning  microwave  sounder;  although  only  a  conical 
microwave  sounder  with  many  of  the  same  channels  had  been  baselined  during  Epoch  A, 
after  the  IORD-1  accepted  many  agency-unique  requirements,  NOAA  enforced  its 
requirement  for  cross-track,  rather  than  conical,  microwave  sounding. 

The  IPO  further  exacerbated  the  complexity  impacts  of  its  multi-instrument  technical 
architecture  by  deciding  to  host  all  of  those  instruments  on  a  common,  aggregated 
spacecraft  bus.  This  decision  induced  architectural  complexity  because  many  of  the 
instruments  adversely  interacted  with  one  another  mechanically,  electromagnetically,  or 
optically;  these  interactions  generated  extra  cost  because  they  had  to  be  managed  and 
mitigated  by  the  program.  For  example,  the  conical  microwave  sounder  induced  a  significant 
amount  of  jitter,  the  radar  altimeter  was  a  lone  active  instrument  hosted  alongside  a 
manifest  of  passive  and  highly  sensitive  instruments,  and  the  solar  irradiance  sensor’s 
preference  for  a  sun-pointing  viewing  geometry  conflicted  with  the  remaining  instruments’ 
requirement  for  a  nadir-pointing  view.  In  these  and  other  examples,  the  program’s  costs 
increased  as  greater  engineering  effort  was  required  to  manage  and  mitigate  architectural 
complexity. 


ACQUISITION  RESEARCH  PROGRAM: 
CREATING  SYNERGY  FOR  INFORMED  CHANGE 


-95- 


1.6 


Uj'i e-lint  Cost 


C  ost  AcTctfd  During  FfPvjruJU.  fcpncjii 


Con  Sultiradftl  Daring  Ep och 
Ctrti  Subtracted  Prevjau*  Epodu 


* 

a 

a. 

£ 

o 

U 

*Ss 


H 


T3 

M 

“ 

£ 


o 

z 


MORE  com  [ilex 
Ih3n  POES& 
DSMP 


LESS  complex 
Ilian  POES  & 
I>MSP 


Decision  2: 

Add  Climate  Science  Mission 


Decision  4: 

No  C upahility  Reduel ions 


Epoch  A 


Epoch  E 


Epoch  F 
\ 

Decision  5: 
Add  NASA 
Require  me  ills 


Decision  1 : 

Define  IORD-1 


i  i - 1 - 1  i - ii  i  > 

^  ^  ^  ^  ^  ^ 

Epochs 


Figure  3.  Decisions  That  Induced  Technical  Complexity  During  the  NPOESS  Program 

In  addition  to  architectural  complexity,  the  IORD-1  induced  design  complexity  by 
levying  each  agency’s  unique  or  driving  requirements  on  single  instruments;  the  primary 
impact  of  this  decision  was  that  neither  agency’s  heritage  instruments  were  capable  of 
meeting  the  lORD’s  joint  requirements  and  that  a  significant  amount  of  new  design  effort 
was  required.  The  best  example  of  instrument  design  complexity  is  the  Visible  Infrared 
Imaging  Radiometer  Suite  (VIIRS)  which  had  to  meet  NOAA’s  driving  requirement  for  high 
radiometric  accuracy  and  the  DoD’s  need  for  high  resolution  imagery.  To  meet  these  and 
other  requirements,  an  instrument  design  based  off  of  NASA’s  Moderate  Resolution  Imaging 
Spectroradiometer  (MODIS)  was  proposed.  However,  to  meet  the  DoD’s  requirement  for 
low-light  imagery,  a  new  scanning  technique  had  to  be  incorporated  into  the  MODIS- 
heritage  design  and  MODIS’s  visible  and  near-infrared  focal  plane  arrays  had  to  be 
combined.  The  program  under-estimated  the  design  and  cost  impacts  of  these  changes 
since  late  in  VI IRS’s  development,  modulated  infrared  background  and  scattered  light 
problems — both  of  which  could  be  traced  back  to  these  deviations  from  MODIS-heritage — 
necessitated  a  re-design  that  delayed  the  program’s  schedule. 

Decision  2  (Add  Climate  Science  Mission):  While  the  complexity  induced  by  IORD-1 
was  substantial,  as  shown  in  Figure  3,  the  next  two  technical  decisions — to  add  climate 
science  to  the  program’s  mission  manifest  and  to  establish  the  NPP  program — induced  the 
greatest  amount  of  design,  architectural,  and  process  complexity  into  the  system.  As  noted 
in  the  section  on  the  history  of  the  NPOESS  Program,  these  decisions  are  related,  since 
climate  science  was  not  an  official  NPOESS  objective  until  the  formation  of  the  dual  mission 
risk-reduction/climate  science  NPP  program. 

New  climate  science  requirements  were  formalized  in  a  revision  to  the  IORD-1  that 
added  long-term  stability  requirements  to  18  environmental  data  records  (EDRs),  tightened 
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horizontal  resolution  requirements  on  18  EDRs,  and  enhanced  requirements  for  uncertainty, 
accuracy,  and  precision  to  20  others;  for  reference,  there  were  55  total  EDRs  in  the  IORD-II. 
The  changes  to  the  IORD  increased  instruments’  design  complexity  since  modifications  and 
new  non-recurring  development  effort  was  required  to  meet  its  new  requirements.  For 
example,  VIIRS — which  also  had  its  specific  sensor  requirements  document  altered  to 
insure  that  its  design  was  backwards  compatible  with  MODIS — evolved  from  14  to  21 
channels  as  a  result  of  adding  climate  science  requirements  to  the  program  (Dwyer,  2014). 

In  addition  to  changing  the  IORD,  the  new  climate  science  mission  altered  the 
program’s  calibration  and  validation  (cal/avl)  plans.  Prior  to  Epoch  C,  the  IPO’s  cal/val  plans 
focused  on  validating  operational  data  products  that  were  produced  rapidly  and  in 
compliance  with  the  system’s  data  latency  specification;  however,  once  the  climate  science 
mission  was  added,  a  separate  NASA  cal/val  team  was  established  to  ensure  that  data 
products  were  also  suitable  for  scientific  research.  Although  in  many  cases  the  dual  teams’ 
roles  were  complementary,  as  detailed  by  The  National  Research  Council  (2000),  climate 
science  cal/val  adds  additional,  distinct  requirements  to  the  operational  process.  Thus,  the 
addition  of  the  climate  science  mission  induced  process  complexity  by  adding  new 
requirements  and  by  increasing  the  amount  of  government  oversight  of  the  cal/val  process. 

Decision  3  (Add  NPP):  The  formation  of  the  NPP  program  itself  also  induced 
additional  process  complexity  in  two  ways.  First,  since  NASA’s  NPP  program  office  was 
responsible  for  integrating  the  program’s  instruments  onto  the  spacecraft  bus  and  for 
mission  systems  engineering,  it  levied  NASA  requirements  on  instruments  that  were 
procured  under  DoD  contracts,  using  DoD  standards.  These  NASA  requirements  induced 
process  complexity  when  systems  engineers  had  to  reconcile  both  sets  of  requirements 
during  V&V — an  exercise  whose  cost  was  not  included  in  the  program’s  initial  estimates. 
Second,  the  unclear  prioritization  between  the  NPP  program’s  dual  missions  induced  a 
significant  amount  of  process  complexity  by  injecting  uncertainty  and  conflict  into  the 
instrument  V&V  process. 

The  cost  impact  of  NPP’s  dual  missions  was  most  visible  when  its  instruments 
experienced  anomalies  or  failures  during  analysis  or  test  because  the  process  used  to 
resolve  issues  for  a  risk  reduction  mission  fundamentally  conflicts  with  the  process  used  for 
a  non-risk  reduction  (i.e.,  a  climate  science)  mission.  Specifically,  on  a  risk  reduction 
mission,  if  a  program  encounters  an  issue  with  an  instrument,  it  identifies  the  issue’s  root- 
cause  and  implements  a  corrective  action  for  the  next  system,  importantly,  any  corrective 
action  that  is  implemented  on  the  risk-reduction  flight  article  is  subject  to  cost  and  schedule 
constraints,  which  enjoy  a  higher  priority  than  instrument  performance  or  functionality. 
Alternatively,  on  a  non-risk  reduction  mission,  full  instrument  performance  and  functionality 
is  paramount  and  necessary  to  achieve  the  mission’s  objectives.  Therefore,  when  issues  are 
encountered  during  instrument  test  or  analysis,  corrective  actions  that  restore  instrument 
performance  are  prioritized — or  least  weighted  equally — to  actions  that  preserve  the 
program’s  cost  and  schedule. 
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Figure  4.  NPP’s  Interfaces  With  NPOESS  IDPS  and  Ground  System 

These  philosophical  differences  generated  conflict  and  uncertainty  when  issues  were 
encountered  during  instrument  analysis  and  test  on  the  NPP  program.  The  resulting  process 
complexity  induced  cost  by  reducing  the  speed  at  which  the  program  could  make  decisions. 
Instead  of  implementing  corrective  actions  consistent  with  one  mission  or  the  other, 
numerous  options  were  debated  and  either  the  most  costly  and  conservative  option  was 
selected  or  the  issue  was  elevated  to  program  management — which  in  several  cases 
involved  the  EXCOM.  Obviously,  because  this  conflict  and  uncertainty  was  not  anticipated, 
the  decision  to  add  the  NPP  program  induced  a  significant  amount  of  process  complexity 
and  cost. 

Finally,  the  NPP  program  also  induced  architectural  complexity  by  creating  two  new 
interfaces  between  the  NPP  and  NPOESS  systems  that  not  only  had  to  be  managed  by  the 
program,  but  also  levied  new  requirements  on  the  system.  First,  as  shown  in  Figure  4, 
although  the  NPP  spacecraft  interfaced  with  the  NPOESS  ground  system,  interface 
definition  was  not  formally  included  on  either  the  spacecraft  or  the  ground  system  providers’ 
contracts.  As  a  result,  the  process  by  which  the  contractors  defined  this  critical  interface  was 
slow  and  cumbersome,  since  negotiations  had  to  include  both  the  ground  system  and  NPP 
spacecraft  contractors,  the  NPOESS  prime  contractor,  and  each  government  agency  which 
held  the  contracts  separately. 

The  interface  between  the  NPP  Science  Data  Segment  (SDS)  and  the  Interface  Data 
Processing  Segment  (IDPS)  of  the  NPOESS  ground  system  also  induced  architectural 
complexity  and  cost  by  creating  a  new  and  previously  unspecified  interface  within  the  data 
processing  system.  As  shown  in  Figure  4,  the  IDPS  processed  data  through  two 
intermediate  stages  before  delivering  EDRs:  the  only  data  products  which  had  performance 
attributes  that  were  specified  on  the  NPOESS  contract.  However,  the  SDS  interfaced  with 
the  IDPS  at  an  intermediate  data  product,  its  Raw  Data  Records  (RDRs),  which  it  then 
transformed  into  Level  1b  data  products  and  Climate  Data  Records  (CDRs)  that  supported 
scientific  research.  However,  because  RDR  performance  was  not  specified  on  the  NPOESS 
contract,  this  new  interface  became  a  mechanism  for  requirements  creep  when  climate 
science  users  needed  the  RDRs  to  be  more  carefully  controlled  and  characterized  so  that 
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they  could  appropriately  manage  the  performance  of  the  climate  science  data  products  that 
were  derived  from  them. 

Decision  4  (No  Capability  Reductions):  While  the  first  three  technical  decisions 
injected  the  greatest  amount  of  complexity  into  the  NPOESS  technical  system,  there  were 
also  architectural  and  process  impacts  from  the  later  decisions  shown  in  Figure  3.  The  fourth 
decision — to  maintain  the  system’s  capability  despite  cost  growth  and  budget  constraints — 
induced  architectural  complexity  when  delays  and  cost  growth  on  one  instrument  induced 
lifecycle  cost  growth  on  others.  For  example,  when  VI IRS’s  costs  grew  but  the  program’s 
budget  remained  fixed,  instead  of  cancelling  sensors  to  free  up  funding,  the  IPO  reduced 
funding  and  extended  the  schedule  of  the  system’s  lower  priority  components.  Of  course, 
this  decision  ultimately  increased  the  lifecycle  cost  of  these  components  and  of  the  system 
as  a  whole. 

Decision  5  (Add  NASA  Requirements):  Finally,  the  fifth  decision — to  unofficially  levy 
NASA  requirements  on  components  of  the  operational  NPOESS  system — added 
unnecessary  process  complexity  by  generating  conflict  between  DoD  and  NASA 
requirements.  As  noted  previously,  components  of  the  NPOESS  system  were  procured 
according  to  DoD  standards;  however,  interviewees  noted  that  during  the  later  years  of  the 
program,  NASA  representatives  began  requesting  that  components  of  the  operational 
system  (i.e.,  not  NPP)  meet  NASA  standards  as  well.  As  in  the  NPP  program,  this  generated 
unnecessary  requirements  conflict,  delayed  decisions,  and  thus,  induced  cost  growth. 

With  the  five  decisions  that  induced  technical  complexity  and  cost  identified,  we  now 
focus  our  discussion  on  understanding  why  the  NPOESS  organization  made  such  costly 
decisions.  The  disconnect  between  technical  complexity  and  the  program’s  reported  cost 
estimates  (shown  previously  in  Figure  2)  suggests  that  the  organization  made  costly 
technical  decisions  because  it  underestimated  and  under-managed  those  decisions’  design, 
process,  and  architectural  complexity  impacts.  According  to  the  principles  we  set  forth 
earlier  in  the  paper  (in  A  Brief  History  of  the  NPOESS  Program  section),  we  assert  that 
these  costly  technical  decisions  were  enabled  and  sustained  by  organizational  complexity 
and  that  organizational  complexity  itself  also  induced  additional  cost  growth.  Finally,  we  also 
suggest  that  agency  interactions  both  with  the  program  and  each  other  were  responsible  for 
injecting  complexity  into  the  NPOESS  organizational  architecture.  With  these  suppositions, 
we  organize  the  next  section  by  identifying  the  agency  interactions  that  induced 
organizational  complexity  and  illustrate  how  that  complexity  enabled,  sustained,  and 
induced  cost  growth. 

Interactions  That  Induced  Organizational  Complexity 

Figure  5  plots  the  evolution  of  organizational  complexity  and  identifies  the  five  major 
agency  interactions  that  induced  it.  As  noted  previously,  we  define  organizational  complexity 
to  be  a  function  of  the  misalignment  of  mission  responsibility  and  decision  authority  and 
factors  that  erode  decision  authority.  Both  misalignment  and  authority  erosion  factors  are 
captured  in  the  DSMs — shown  in  miniaturized  form — and  by  the  value  of  the  complexity 
metric  that  was  calculated  for  each  epoch.  In  this  section,  we  review  the  agency  interactions 
that  induced  organizational  complexity  and  describe  how  this  complexity  enabled  and 
sustained  the  costly  technical  decisions  discussed  in  a  previous  section  (Decisions  That 
Induced  Technical  Complexity)  and  induced  further  cost  growth  by  hindering  the 
organization’s  decision-making  process. 

Interaction  1  (Delegate  Decision  Authority  to  the  EXCOM):  First,  Figure  5  identifies 
Interaction  1  as  the  foundational  policy  directive — the  agencies’  Memorandum  of  Agreement 
(MOA) — that  delegated  each  agency’s  decision  authority  to  the  EXCOM;  as  shown,  this 
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directive  affected  organizational  complexity  throughout  the  NPOESS  program.  Although  the 
purpose  of  the  EXCOM  was  to  provide  a  venue  for  the  agencies  to  make  decisions 
collaboratively,  its  decision  authority  was  eroded  throughout  the  program.  For  example,  the 
EXCOM  did  not  meet  frequently  enough  or  with  a  full  quorum  of  its  members,  to  make 
effective  decisions  (GAO,  2005,  2009).  Furthermore,  although  each  agency  delegated  its 
decision  authority  to  the  EXCOM,  the  agencies  did  not  fully  delegate  their  mission 
responsibilities;  as  a  result,  the  agencies  continued  to  independently  oversee  the  program. 
This  action  generated  extra  work  for  the  IPO,  which  had  to  be  responsive  to  three  agencies’ 
requests  for  information.  Unfortunately,  this  extra  oversight  did  not  affect  positive  change, 
since  the  agencies’  only  mechanism  for  making  decisions  was  through  the  EXCOM.  Thus, 
we  observed  that  a  misalignment  of  mission  responsibility  and  decision  authority  enabled 
and  sustained  cost  growth  by  preventing  agencies  from  unilaterally  taking  action  to  reduce 
cost  and  induced  it  by  generating  extra  oversight  and  by  delaying  decisions  that  had  to  be 
made  collaboratively  by  the  EXCOM. 


Figure  5.  Agency  Interactions  That  Induced  Organizational  Complexity  During  the 

NPOESS  Program 

Importantly,  the  MOA  that  formed  the  NPOESS  program  did  not  establish  the 
EXCOM  as  the  organization’s  central  decision-making  component.  We  suggest  that  the 
complexity  of  the  organizational  hierarchy  beneath  the  EXCOM — and  particularly  the 
misalignment  of  mission  responsibility  and  decision  authority — forced  the  EXCOM  to  play  a 
decision-making  role  that  was  never  intended  by  the  MOA.  Thus,  while  the  EXCOM  itself  did 
contribute  to  organizational  complexity  and  to  the  program’s  costs,  we  argue  that  it  was  the 
complexity  of  the  organizational  architecture  beneath  the  EXCOM  that  most  significantly 
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affected  complexity  and  cost  growth;  the  agency  interactions  that  induced  this  complexity 
are  identified  below. 

Interaction  2  (Use  Optimized  Convergence  Strategy):  As  shown  in  Figure  5,  the 
second  agency  interaction,  to  delay  the  first  satellite  need-date  and  to  constrain  early 
funding  profiles,  resulted  in  a  directive  to  use  the  optimized  convergence  acquisition  strategy 
and  ultimately,  a  program  that  was  more  complex  than  the  separate  POES  and  DMSP 
organizations.  Unlike  traditional  acquisition  strategies,  which  concurrently  select  all  of  a 
system’s  contractors,  the  optimized  convergence  strategy  issued  multiple,  multi-year,  and 
separate  risk  reduction  contracts  for  the  system’s  key  components.  This  strategy  enabled 
the  agencies  to  reduce  the  program’s  early  funding  and  to  adjust  its  schedule  to  better  align 
with  the  final  launches  of  POES  and  DMSP. 

Despite  these  advantages,  optimized  convergence  induced  organizational 
complexity  in  two  ways.  First,  it  eroded  decision  authority  by  weakening  the  organization’s 
financial  responsibility  for  its  decisions.  Specifically,  until  Epoch  D,  sensor  vendors  were  still 
in  competition  to  win  final  contracts;  as  a  result,  until  those  contracts  were  awarded,  sensor 
vendors  had  a  greater  incentive  to  manage  their  proposed  costs  rather  than  their  proposals’ 
potential  design  complexity.  Furthermore,  in  accordance  with  its  Total  System  Performance 
(TSPR)-like1  contracts,  the  IPO  relied  heavily  on  contractor-produced  cost  estimates  when  it 
assessed  its  overall  cost;  consequently,  the  IPO’s  earliest  estimates  were  skewed  by  the 
competitive  environment  that  was  fostered  by  optimized  convergence.  As  a  result,  the 
quality  of  their  technical  decisions  was  poor,  since  the  IPO  was  unable  to  appropriately 
assess  each  decision’s  cost.  For  example,  the  climate  science  mission  was  added  before 
the  sensor  vendors  were  on  contract;  as  a  result,  when  the  IPO  requested  a  requirements 
change,  sensor  vendors  reported  minimal  cost  impacts  in  the  hopes  that  doing  so  would 
enable  them  to  win  the  final  contract.  This  enabled  early  instrument  design  complexity  to  be 
under-estimated  during  the  program’s  early  epochs. 

The  optimized  convergence  strategy  also  enabled  architectural  complexity  to  be 
under-estimated  and  under-managed  because  it  misaligned  mission  responsibility  and 
decision  authority.  Specifically,  although  the  IPO  intended  to  award  a  TSPR-like  prime 
contract  that  would  assign  mission  responsibility  for  managing  and  integrating  all 
components  of  the  NPOESS  system  to  a  single  company,  that  company  was  not  selected 
until  Epoch  D.  As  a  result,  during  the  program’s  early  epochs,  its  prospective  prime 
contractors  had  no  direct  decision  authority  over  the  components  for  which  they  would 
ultimately  be  responsible.  Interviewees  reported  that  prior  to  Epoch  D,  the  prime  contractor 
had  limited  insight  into  the  instruments’  development  and  had  no  authority  to  require 
changes  or  to  request  additional  information  directly  from  the  sensor  vendors.  As  a  result, 
once  the  prime  contractor  was  selected  and  the  sensor  contracts  transitioned  from  the 
government  to  the  prime,  the  prime  contractor  discovered  that  instrument  designs  were  less 
mature  than  the  complexity  and  cost  assumptions  that  it  used  in  its  proposal. 

Given  this  immaturity,  instrument  mass  and  power  continued  to  grow  well  into  Epoch 
D;  for  example,  between  Epochs  C  and  E,  VI IRS’s  mass  and  power  grew  by  34%  and  48%, 
respectively  (Dwyer,  2014).  With  such  growth  on  VIIRS  and  other  instruments,  the  prime 


1  Officially,  NPOESS  contracts  were  Shared  System  Performance  Responsibility  (SSPR);  however,  our  data 
suggests  that,  in  practice,  there  was  little  difference  between  SSPR  and  TSPR. 
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contractor  unexpectedly  struggled  to  close  spacecraft  mass  and  power  budgets.  Similarly, 
mechanical  and  electromagnetic  interferences  between  instruments  do  not  appear  to  have 
been  actively  managed  until  Epoch  D,  when  the  prime  contractor  was  finally  awarded 
decision  authority  over  the  components  for  which  it  was  responsible. 

Interaction  3  (Formalize  NASA’s  Role):  As  shown  in  Figure  5,  the  third  agency 
interaction — to  formalize  NASA’s  role  in  the  larger  NPOESS  program  by  establishing  its 
authority  over  NPP  and  the  program’s  new  climate  science  mission — had  the  greatest 
impact  on  organizational  complexity  because  of  how  significantly  it  misaligned  decision 
authority  and  mission  responsibility.  Figure  7  illustrates  one  example  of  the  misalignment 
that  was  induced  by  the  formation  of  NPP  using  the  VIIRS  sensor  vendor’s  relationship  to 
surrounding  organizational  components.  As  shown,  there  was  a  mission  responsibility 
relationship  between  the  VIIRS  sensor  vendor  and  the  NPP  program  office:  in  order  to 
execute  NASA’s  climate  science  mission,  the  VIIRS  sensor  vendor  had  to  develop  an 
instrument  that  met  the  needs  of  NPP’s  climate  science  users.  Importantly,  despite  this 
relationship,  there  was  no  contractual,  or  decision  authority  relationship,  between  NPP  and 
the  sensor  vendor.  This  left  NPP  with  two  options  to  execute  its  mission  responsibility:  (1 )  to 
influence  decisions  informally  at  the  contractor  level  or  (2)  to  elevate  issues  to  the 
organizational  component  that  held  decision  authority  over  both  the  NPP  program  office  and 
the  VIIRS  sensor  vendor. 

By  attempting  to  influence  the  VIIRS  sensor  vendor’s  decisions  informally,  the  NPP 
program  office  ultimately  eroded  the  decision  authority  that  the  prime  contractor  and  the  IPO 
held  over  VIIRS.  As  noted  above,  eroded  decision  authority  contributed  to  organizational 
complexity  and  in  this  particular  example,  decision  authority  was  eroded  in  two  ways.  First, 
NPP  provided  a  significant  amount  of  technical  support  to  the  sensor  vendor.  While  the 
value  of  this  added  technical  capability  should  not  be  under-stated,  it  also  eroded  the  prime 
contractor  and  the  IPO’s  decision  authority  by  second-guessing  their  decisions.  This 
interaction  was  exacerbated  by  a  second  factor  that  eroded  decision  authority:  the  fact  that 
NPP  was  not  financially  responsible  for  its  decisions.  As  noted  previously,  the  IPO  funded 
three  of  NPP’s  instruments,  while  NASA’s  NPP  program  office  funded  the  spacecraft  and 
launch.  The  misalignment  of  mission  and  financial  responsibility  for  NPP’s  instrument’s 
caused  the  NPP  program  office  to  inappropriately  weigh  risk  vice  cost  when  making 
technical  decisions — particularly  those  that  involved  the  prioritization  of  NPP’s  dual 
missions. 
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Figure  6.  A  Portion  of  the  NPOESS  Decision  Authority  Structure  That  Illustrates  a 
Critical  Misalignment  of  Decision  Authority  &  Mission  Responsibility 
Between  Sensor  Vendor  &  the  NPP  Program  Office 

As  described  in  the  section  titled  Decisions  That  Induced  Technical  Complexity,  the 
impact  of  eroded  decision  authority  at  the  contractor  level  was  that  decisions  were  delayed 
as  multiple  options  were  debated,  the  most  costly  and  conservative  option  was  selected,  or 
decisions  were  elevated  for  arbitration.  In  the  latter  case,  as  shown  in  Figure  6,  the  only 
component  that  held  decision  authority  over  both  NPP  and  the  IPO  was  the  EXCOM.  Thus, 
elevating  decisions  induced  further  cost  growth,  since  the  contractors’  decisions  were  stalled 
as  issues  were  raised  through  each  agency’s  organizational  hierarchy  so  they  could  be 
discussed  by  agency  leaders  at  the  EXCOM. 

Interaction  4  (Maintain  the  Baseline):  While  initial  agency  interactions  had  the 
greatest  impact  on  the  program’s  organizational  complexity,  as  shown  in  Figure  5,  the 
remaining  interactions  also  enabled  and  induced  cost  growth.  The  fourth  interaction, 
between  the  agencies’  user  communities,  hindered  the  program’s  ability  to  alter  its  technical 
baseline;  this  enabled  the  architectural  complexity  that  was  discussed  previously  (in 
Decisions  That  Induced  Technical  Complexity  section) — when  cost  growth  on  one 
instrument  induced  lifecycle  cost  growth  on  others.  Interaction  4  also  induced  organizational 
complexity  by  eroding  the  IPO’s  decision  authority:  because  essentially  any  member  of  the 
IPO’s  user  advisory  councils  could  veto  proposals  that  reduced  the  system’s  capability,  the 
IPO  struggled  to  make  these  decisions.  Importantly,  agency  management  also  failed  to 
intervene  by  directing  capability  reductions  or  by  providing  the  funding  that  was  necessary  to 
support  the  system’s  numerous  capabilities. 

Interaction  5  (Enhance  NASA’s  Role):  As  shown  in  Figure  5,  after  the  Nunn- 
McCurdy  certification  process  added  a  PEO,  organizational  complexity  decreased:  indeed, 
the  purpose  of  the  PEO  was  to  improve  the  alignment  of  mission  responsibility  and  decision 
authority  between  NPP  and  the  IPO  and  to  reduce  the  number  of  decisions  that  were 
elevated  to  the  EXCOM.  Flowever,  the  fifth  agency  interaction — which  enhanced  NASA’s 
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influence  both  in  the  program  and  in  NOAA’s  National  Environmental  Satellite,  Data,  and 
Information  Service  (NESDIS) — eroded  the  PEO’s  decision  authority  and  ultimately 
rendered  the  position  ineffective.  Thus,  the  misalignment  of  mission  responsibility  and 
decision  authority  between  NPP  and  the  IPO  continued  to  induce  non-technical  cost  growth 
as  decisions  were  delayed  or  elevated  to  the  EXCOM. 

The  above  discussion  illustrates  how  significantly  agency  interactions,  that  were 
external  to  the  program  itself,  impacted  NPOESS’s  complexity  and  cost.  Each  agency 
interaction  injected  complexity  into  the  NPOESS  organization  that  enabled,  sustained,  and 
induced  costly  technical  decisions.  Although  we  do  not  speculate  on  why  the  program’s 
agency  collaborators  took  these  actions,  we  suggest  that  by  observing  how  agency  actions 
have  impacted  programs’  organizational  and  technical  architectures  in  the  past,  we  can 
inform  and  improve  actions  in  the  future.  In  the  case  of  the  NPOESS  program,  agency 
interactions’  induced  organizational  complexity  that  weakened  technical  decision  making 
from  the  EXCOM  through  the  instrument  sub-contractors  and  hindered  the  organization’s 
ability  to  make  anything  but  the  costly  technical  decisions  that  it  did. 

Assessing  the  Impacts  of  Jointness 

Now  that  we  have  reviewed  the  technical  decisions  and  agency  interactions  that 
induced  technical  and  organizational  complexity  throughout  the  NPOESS  program,  we 
return  to  our  definition  of  jointness  and  connect  the  identified  complexity  mechanisms  to  the 
concept  of  technical  and  organizational  aggregation.  Three  types  of  technical  aggregation 
induced  the  complexity  and  cost  growth  that  was  discussed  in  an  earlier  section  (Decisions 
That  Induced  Technical  Complexity).  First,  we  observed  that  requirements  aggregation  in 
the  IORD — specifically,  that  each  agency  levied  their  unique  or  driving  requirements  on  the 
system — induced  design  complexity  in  the  program’s  instruments  because  neither  agencies’ 
heritage  instruments  were  capable  of  meeting  the  program’s  joint  requirements.  This 
outcome  suggests  that  when  a  program’s  requirements  are  defined  jointly,  they  can  induce 
cost  growth  by  necessitating  new  technology  development.  Since  the  cost  of  developing 
new  technology  is  highly  uncertain  and  the  program  invested  in  multiple  uncertain 
development  projects  with  a  limited  budget,  overruns  on  one  project  induced  lifecycle  cost 
growth  on  others.  This  suggests  that  when  an  aggregated  architecture  contains  numerous 
technically  immature  components,  not  only  can  the  components  themselves  induce  cost 
growth,  but  so  too  can  the  resource  dependencies  between  them;  as  a  result,  the  risk  of 
cost  growth  on  an  aggregated  program  is  not  only  a  function  of  the  number  of  immature 
components  but  also  a  function  of  the  number  of  potential  interactions  between  them. 

Finally,  we  also  observed  requirements  aggregation  by  noting  that  multiple  agency 
standards  were  levied  on  the  system  and  that  by  doing  so,  the  agencies  induced  process 
complexity  by  generating  extra  and  unnecessary  work  for  the  engineers  who  were  tasked 
with  reconciling  disparate  technical  standards.  This  suggests  that  unless  joint  programs 
accept  and  consistently  utilize  one  agency’s  technical  standards,  costs  will  be  induced  when 
the  program  is  forced  to  meet  both. 

Second,  we  observed  that  spacecraft  aggregation,  or  assigning  multiple  instruments 
to  share  the  same  spacecraft  bus,  induced  architectural  complexity  when  instruments 
interfered  electromagnetically,  mechanically,  and  optically.  We  also  observed  that 
spacecraft  aggregation  induced  design  complexity  in  the  spacecraft  bus  itself,  since  the 
prime  contractor  had  to  re-design  critical  aspects  of  its  standard  bus.  These  outcomes 
suggest  that  technical  aggregation  can  induce  both  design  and  architectural  complexity  that 
should  be  actively  managed  so  that  the  program  can  appropriately  budget  for  the  cost  of  this 
complexity  or  consider  alternative  disaggregated  architectures  that  reduce  it.  Third,  we 
observed  that  mission  aggregation  induced  process  complexity  because  NPP’s  dual 
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missions  were  not  prioritized.  This  suggests  that  unless  systems  execute  single  missions, 
their  multiple  missions  need  to  be  clearly  prioritized  at  the  outset  of  the  program. 

Like  the  technical  architecture,  several  of  the  complexity  mechanisms  in  the 
organizational  architecture  can  be  attributed  to  aggregation.  For  example,  we  noted  that 
NPP’s  additional  source  of  technical  capability  eroded  contractor  and  IPO  decision  authority 
by  second-guessing  decisions  on  instruments  like  VIIRS.  This  suggests  that  if  multiple 
sources  of  technical  capability  converge  at  a  single  organizational  component  (like  the 
VIIRS  sensor  vendor),  those  sources  should  be  aligned  with  single  source  of  decision 
authority.  We  also  noted  that  delegating  agency  decision  authority  to  the  EXCOM  induced 
complexity  because  the  EXCOM’s  decisions  were  infrequent  and  its  decision  authority  was 
misaligned  with  the  agencies’  individual  mission  responsibilities.  We  suggest  that  this  source 
of  complexity  may  be  inherent  to  all  joint  programs,  since  individual  agencies’  mission 
responsibilities  are  often  derived  from  separate  congressional  committees.  Thus,  future  joint 
programs’  budgets  should  include  additional  funding  to  facilitate  the  extra  government 
oversight  that  is  required  to  enable  each  agency  to  individually  fulfill  its  mission 
responsibilities. 

However,  most  importantly,  we  noted  that  the  majority  of  the  NPOESS  organization’s 
complexity  was  a  result  of  the  disaggregation,  rather  than  the  aggregation,  of  critical 
relationships  between  organizational  components.  Specifically,  although  the  NPOESS 
organization  was  tasked  to  develop  an  aggregated  technical  system,  responsibility  and 
authority  for  that  system  were  separated  across  numerous  and  distinct  components  of  the 
NPOESS  organization.  For  example,  the  separation  of  NPP’s  mission  and  financial 
responsibility  for  the  program’s  instruments  impeded  cost-risk  trades  and  ultimately  strained 
the  agencies’  collaboration.  Additionally,  the  separate  IPO  and  NPP  program  offices 
fractionated  decision  authority  and  crippled  decision-making  since  technical  issues  raised  by 
vendors  for  shared  IPO-NPP  sensors  could  only  be  resolved  by  the  EXCOM.  Finally,  the 
optimized  convergence  strategy  separated  the  prime  contractor,  which  would  ultimately  hold 
financial  and  mission  responsibility  for  the  system’s  instruments  and  interfaces,  from  the 
decision  authority  to  manage  the  system  until  10  years  into  the  program,  after  most  of  the 
critical  cost-inducing  decisions  had  already  been  made. 

Conclusions 

So  was  organizational  and  technical  aggregation — or  jointness — to  blame  for  the 
NPOESS  program’s  cost  growth?  The  answer,  of  course,  is  both  yes  and  no.  In  terms  of 
technical  jointness,  requirements  and  mission  aggregation  undoubtedly  induced  design  and 
process  complexity  that  contributed  to  the  program’s  costs.  While  these  requirements  and 
missions  were  aggregated  by  different  users  and  agencies,  the  resulting  requirements  creep 
was  similar  to  other  government  acquisition  programs  and  is  not  necessarily  unique  to 
jointness.  Spacecraft  aggregation  also  induced  architectural  complexity,  but  it  is  unclear 
whether  it  would  have  been  more  cost  effective  to  disaggregate  the  NPOESS  program’s 
multiple  instruments  onto  different  platforms.  As  shown  in  Figure  2,  in  the  program’s  earliest 
epochs,  the  aggregated  spacecraft  architecture  was  actually  less  costly  than  the 
disaggregated  POES  and  DMSP  systems.  Using  these  observations  from  the  NPOESS 
program,  we  recommend  that  to  mitigate  the  potential  cost  growth  that  can  be  induced  by 
technical  aggregation,  future  joint  programs  should: 

•  Recognize  that  joint  requirements  hinder  a  program’s  ability  to  leverage 
individual  agencies’  heritage  capabilities  and  budget  for  the  technology 
development  that  is  necessary  to  integrate  all  of  those  capabilities  into  a 
single  system. 
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•  Utilize  common  standards  or  invest  in  non-recurring  system  engineering  effort 
to  reconcile  different  standards. 

•  Budget  for  interactions  between  instruments  and  for  the  cost  of  spacecraft 
aggregation. 

In  terms  of  organizational  jointness,  it  was  the  separation  of  financial  responsibility, 
mission  responsibility,  and  decision  authority  that  contributed  most  significantly  to  the 
program’s  costs.  Some  of  the  organization’s  complexity — like  that  induced  by  the  program’s 
optimized  convergence  strategy  and  TSPR-like  contracts — was  not  a  result  of  jointness. 
However,  the  complexity  induced  by  the  separation  of  the  NPP  and  IPO  program  offices,  the 
ability  of  the  program’s  user  community  to  veto  all  capability-reducing  decisions,  and  the 
erosion  of  the  PEO’s  authority,  were  all  induced  by  the  joint  nature  of  the  program.  Using 
these  observations  from  the  NPOESS  program,  we  recommend  that  future  joint  programs 
should 


•  Award  contracts  early  in  the  system’s  lifecycle  and  concurrently  for  all  of  the 
system’s  components. 

•  Fully  integrate  responsibility,  authority,  and  technical  capability  into  a  single 
program  office. 

•  Institute  a  PEO-like  authority  structure  over  the  user  community  to  enable 
capability  reductions. 

Most  importantly — particularly  for  government  agencies  that  are  contemplating  the 
merits  of  future  aggregated  or  disaggregated  programs — our  analysis  suggests  that  the 
greatest  source  of  complexity  and  cost  on  the  NPOESS  program  was  not  directly  function  of 
aggregation,  but  rather,  was  a  result  of  the  mismatch  between  the  NPOESS  program’s 
aggregated  technical  but  disaggregated  organizational  architectures.  Specifically,  although 
the  NPOESS  organization  developed  an  aggregated  technical  system,  it  did  so  with  two 
disaggregated  NPP  and  IPO  program  offices.  As  discussed  above,  the  disaggregated 
program  offices  both  misaligned  responsibility  and  authority,  eroded  the  IPO’s  decision 
authority,  and  were  responsible  for  much  of  the  technical  complexity  that  was  induced  by  the 
addition  of  NPP  and  the  climate  science  mission. 

Given  this  observation,  we  suggest  that  both  aggregated  and  disaggregated 
programs  can  be  executed  cost-effectively  as  long  as  the  program’s  organizational  and 
technical  architectures  match.  Specifically,  we  recommend  that 

•  Aggregated  technical  architectures  should  be  developed  by  fully  aggregated 
organizations  with  single  program  offices. 

•  And  that  disaggregated  technical  architectures  should  also  be  developed  by 
single  program  offices  and  that  importantly,  these  offices  should  be 
disaggregated  from  one  another. 

For  example,  if  the  DoD  disaggregates  its  follow-on  to  DMSP  into  three  separate 
systems  that  focus  on  visible-infrared,  microwave,  and  space  weather  data,  it  should 
establish  three  separate  program  offices  to  manage  their  development  and  should  minimize 
the  organizational  relationships  between  them.  Of  course,  our  recommendation  is  not 
without  policy  risks.  With  numerous  capabilities  disaggregated  across  multiple  technical 
systems,  agency  leaders  may  see  opportunities  for  efficiency  and  cost-savings  if 
management  responsibilities  are  shared  across  related  program  offices.  Similarly,  with 
numerous  capabilities  aggregated  into  a  single  technical  system,  agency  collaborators  may 
prefer  to  divide  responsibilities  within  an  aggregated  organization  while  continuing  to  share 
decision  authority.  In  both  cases,  the  tendency  towards  mismatching  a  program’s 
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organizational  and  technical  architecture  can  result  in  the  type  of  complexity  and  cost  growth 
that  we  observed  on  the  NPOESS  program.  However,  as  on  NPOESS,  we  suggest  that  this 
complexity  is  ultimately  induced  by  agency  interactions,  which  we  hope  will  be  informed  and 
improved  by  this  and  future  analyses  of  joint  programs. 
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A  Future  for  Jointness? 
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Thanks! 


Please  email  mdwyer@mit.edu  with  questions. 
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